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COMMENTARY 

Mechanistic Vs. Empirical Network IVIodels of Drug Action 

MR Birtwistle', DE Mager' and JM Gallo' 

Declining success rates coupled with increased costs is leading to an inevitable breaking point in the drug development pipeline. 
Can we avoid it by incorporating the vast mechanistic understanding of drug action? A recent review highlights this dilemma 
and proposes "quantitative logic gate" modeling as a solution.^ The goal of this commentary is to contrast this approach with 
mechanistic biochemical network models, which, although alluded to by Kiruoac and Onsum, requires a closer analysis. 
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Although the drug development pipeline may be construed 
differently, many believe that it is important to have a compu- 
tational modeling layer to explore, in a relatively inexpensive 
manner, potential scenarios for how drugs may be used. This 
computational layer has been embodied in model-based drug 
development (MBDD) — supported by regulatory agencies 
and industry alike — yet newer systems-based approaches 
will likely impact the future of MBDD. It is posited that sys- 
tems-based modeling, due to its ability to predict drug effects 
on cell-signaling networks, will have a large impact and lend 
confidence to MBDD. Even though many types of systems- 
based approaches exist, they share a pervasive feature of 
being quantitative.^ 

In their recent review, Kirouac and Onsum promote one 
particular approach to systems-based signal transduc- 
tion modeling in the context of MBDD for oncology termed 
"quantitative logic" (QL).^ QL models incorporate some notion 
of connectivity between central nodes of cell-signaling net- 
works, yet retain the ease-of-implementation of coarse- 
grained, empirical representations. At the core, QL is the 
widely used Hill-type equation, which generally relates the 
magnitude of an input Xto the magnitude of an output /via a 
sigmoidal relationship (Figure 1a). QL, via alterations to the 
Hill equation, can account for multiple inputs having additive, 
synergistic or antagonistic affects on the output by account- 
ing for various wirings, such as "OR," where two inputs have 
independent but additive effects on /(Figure 1b), or "AND," 
where two inputs are simultaneously needed to increase / 
(Figure 1c). The authors similarly suggest how, using princi- 
ples of linear dynamical systems theory, one may incorporate 
time-dependency into QL that necessarily increases the num- 
ber of empirical parameters and the amount of data needed 
to constrain the model. 

Four hallmarks of cell-signaling networks — modularity, 
redundancy, adaptation, and heterogeneity — are offered as 
support for QL approaches in drug development; in essence, 
arguing that condensed, nonspecific networks of QL models 
will capture signaling dynamics although remaining relatively 
easy to develop.^ This feature is attained by coarse-graining 
the underlying complexity of the signal transduction network. 
Importantly, however, this empirical coarse-graining comes 
with trade-offs that may limit the applicability of QL to MBDD 



because (i) apart from new, explicitly designed experiments, 
there is no clear way to predict how new drugs or drug combi- 
nations affect signaling network behavior; (ii) interpreting the 
quantitative effects of common genetic variations or mutations 
is not straightforward; (iii) capturing cell-to-cell heterogeneity 
requires empirical sampling approaches whose consistency 
with known biological variation is not well understood; and (iv) 
scaling preclinical model parameters to patient models with- 
out a biochemical foundation will be difficult."^ Mechanistic, 
or physiochemical models of signal transduction networks, 
however, are based on fundamental biophysical assumptions 
and provide a direct means to addressing these four issues 
(illustrated below), albeit at the cost of having more complex, 
larger models. By no means are mechanistic models (MMs) a 
panacea, yet the network specificity MMs represent seems to 
offer potential solutions to these shortcomings of QL models. 

As a test case, we consider a previously published MM 
of receptor tyrosine kinase signaling^ that relates epider- 
mal growth factor- and heregulin-p-induced activation of 
the ErbB (aka HER) receptors to activation of ERK and Akt 
(Figure 2a), two central pathway end points controlling pro- 
liferation and apoptosis. Underlying this simplified schematic 
is a system of 117 ordinary differential equations that were 
mainly derived based on chemical kinetics theory. Similar to 
Figure 4 of the Kiruoac and Onsum review,^ it can also be 
cast as a QL model (Figure 2b), where for simplicity of this 
commentary we consider only ErbBI (aka EGFR) and ErbBS 
receptors. We used the MM to simulate how active ERK and 
active Akt levels (denoted by *) depend on levels of active 
ErbBI (pErbBI) and active ErbBS (pErbBS) SOmin after epi- 
dermal growth factor or heregulin-p stimulus (approaching a 
steady-state), and then considered these as data with which 
to build the QL model (see Supplementary Data online 
for MATLAB files; The Mathworks, Natick, MA). Figure 2c 
shows that the QL model (solid lines) provides an excellent 
description of the simulated data (X symbols) for how both 
active ERK and Akt levels depend on active receptor levels. 
Therefore, both model types provide quantitative descriptions 
of this cell-signaling network, as expected. 

An important goal of MBDD is to predict the effects of new 
drugs or new drug combinations before extensive experimen- 
tal testing (point (i) above). We consider predicting whether 
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Figure 1 Overview of QL functions and behavior, (a) A basic Hill 
function relating the input Xto the output Y. Y^^^ is the maximum 
possible value V^can admit, X^^ is the input magnitude causing half- 
maximal output (i.e., Y= and n is the Hill coefficient that 
determines the "steepness" of the response. The X-V relationships 
are plotted for various parameter values (equal to 1 unless indicated 
otherwise), (b) The QL OR function which combines inputs Xand 
1/1/ to yield the output Y. The effect of increasing the 2nd input 1/1/ is 
shown in the plot, for parameter values as indicated at the top of the 
plot, (c) The QL AND function which also combines inputs Xand I/l/to 
yield the output Y. The effect of increasing the 2nd input 1/1/ is shown 
in the plot, for parameter values as indicated at the top of the plot. 
QL, quantitative logic. 

connbining a low affinity, connpetitive Raf inhibitor having a 
100 nnnol/l inhibition constant with a connpetitive ErbB1 inhibi- 
tor with 10 nnnol/l affinity for ErbBI and ErbB2 (e.g., lapatinib) 
would be an effective way to block 1 0 nnnol/l epidernnal growth 
factor-driven ERK signaling, given 100 nnnol/l drug concen- 
trations. In the MM, by sinnply altering the rate equation for 
Raf-catalyzed phosphorylation of MEK in a nnanner consis- 
tent with connpetitive inhibition, and likewise for the receptor 
inhibitor, the MM predicts a nnodest 58% decrease in ERK* 
(Figure 2d). To recapitulate these effects with a QL nnodel, 
we try decreasing the level of pErbBI by 90% (strong recep- 
tor inhibitor) and increasing the X^^ of the ERK* OR function 
by 25% (weak Raf inhibitor). Under these conditions, the QL 
nnodel predicts a 77% decrease in ERK* (Figure 2d). 

The QL nnodel predictions differ substantially fronn those of 
the MM, to the point where it nnay alter decision nnaking. Why? 
One likely nnajor reason is that in defining nnodularity based 
on Figure 4 of ref. 1 , the QL nnodel is nnissing the key dynann- 
ics that are necessary to predicting drug response. Therefore, 
using additional experimental data and creating cascades of 
QL-subnnodel networks, such as considering PI-3K, Raf, and 



MEK independently, should yield innproved predictions. How- 
ever, it rennains unclear on how to define such finer-grained 
nnodules a priori an6 also how to innplennent the nnechanistic 
effects of new drugs precisely. What paranneters of the QL 
nnodel do we alter to nnake new drug predictions such as 
those considered above, and by how nnuch do we alter thenn? 
Therefore, we would argue that MM predictions, which allow 
for a direct interpretation and innplennentation of drug action, 
have nnore value in MBDD. 

Another goal of MBDD is personalized nnedicine: nnaking 
predictions based on paranneters that are specific to particular 
patients. In the context of oncology, this predonninantly nneans 
incorporating the effects of genetic nnutations into predictions 
(point (ii) above).^ One very connnnon genetic aberration is an 
activating PI-3K nnutation; we consider one that raises its cat- 
alytic activity by threefold. In the MM, sinnulating the effects of 
this nnutation on ERK* and Akt* levels is straightforward; sinn- 
ply increasing the /c^^f for PI-3K by threefold causes a tenfold 
increase in Akt* and a 1 .43-fold increase in ERK* (Figure 2e). 
For the QL nnodel, again however, without explicit experinnen- 
tal data, it is not clear on how we nnight alter the paranneters 
to innplennent the PI-3K nnutation. We attennpt to sinnulate this 
nnutation by decreasing the X^^ values for the Akt OR function 
by 100%, which predicts a 1.6-fold increase in Akt* and no 
change in ERK*. These QL sinnulation results are again quite 
different fronn those of the MM; the above discussion applies 
here also. 

It is beconning increasingly appreciated that cellular hetero- 
geneity plays a nnajor role in anticancer drug sensitivity and 
resistance (point (iii) above), and one nnechanisnn by which 
this occurs is gene expression noise: natural variation in pro- 
tein levels fronn cell to cell. Several studies have shown that 
such variations can be accounted for in MMs by sannpling 
initial protein level conditions fronn biologically reasonable 
distributions, and subsequently looking at the distribution of 
signaling outputs.^'^ How can one perfornn such sinnulations in 
a QL frannework? As suggested by Kiruoac and Onsunn,^ one 
can sannple the various paranneters of the QL nnodel and per- 
fornn several sinnulations, but which ones do we sannple, fronn 
what distribution, and what is their variance? These questions 
are difficult if not innpossible to answer due to the ennpirical 
nature of QL nnodels. 

The aforennentioned exannples sinnply illustrate the fact 
that as QL nnodels are ennpirical, they have difficulties nnak- 
ing predictions outside the experinnental data for which they 
were trained. MMs, however, allow for such extrapolative 
predictions because their paranneters and variables have 
explicit physical nneaning. However, there are currently nnany 
issues with MMs that nnust be solved before they are practi- 
cally useful. Model identifiability is a nnajor one; it is not cur- 
rently understood on how to design experinnents such that 
we have high confidence in both the nnodel structure and its 
estinnated paranneter values. This problenn is dinninished by 
"sloppiness,"^ where paranneter uncertainty has snnall effects 
on predictions; however, it is unclear a priori \o which predic- 
tions sloppiness applies. Moreover, in sonne situations, our 
nnechanistic knowledge is inconnplete, necessitating the use 
of ennpirical nnethods, for which such QL approaches nnay be 
appropriate. In the absence of biochennical data, QL nneth- 
ods nnight serve to codify qualitative relationships and guide 
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Figure 2 Comparing a MM with a QL model, (a) A simplified schematic of an MM for ErbB receptor signaling, adapted with permission from 
Birtwistle etal., 2007. (b) A QL representation of ErbB signaling along the lines of Figure 4, Kiruoac and Onsum.^ (c) Simulated ERK and Akt 
activation 30min after EGF and/or HRG stimulus (various doses and combinations) as a function of active ErbB1 and ErbB3 levels. Black X 
symbols correspond to MM simulations and solid blue lines correspond to QL fit of model simulations. QL model parameters were estimated 
by fitting to the MM simulation data using the MATLAB function Isqnonlin (see Supplementary Data online) and Y^^^ = 593.5; X^^ = 1 .34; n = 
0.92; = 0.79; = 0.99 for the ERK OR function and Y,,,^ = 1 9.6; X, = 2.26; n = 1 .08; i/i/ = 0. 1 5; i/i/ = 0.89 for the Akt OR function. The various 

'I '2. MAX '50 1 2. 

curves on each plot depict different levels of pErbB3, with increasing amounts of pErbB3 shifting the curves upward, (d) Predicted % inhibition 
of active ERK 30min after 10 nmol/l EGF stimulation in the presence of a strong receptor inhibitor and weak Raf inhibitor as described in the 
main text, (e) Predicted fold-increase in Akt and ERK signaling 30 min after 1 0 nmol/l EGF stimulus as a consequence of a PI-3K mutation. 
Increases in Akt signaling are the first two columns, and ERK are the last two columns. EGF, epidermal growth factor; HRG, heregulin-p; 
MM, mechanistic model; QL, quantitative logic. 



the experinnentation and nnathennatical nnodeling required to 
develop MMs. In fact, connbining QL and MM approaches into 
a hybrid nnodel is a viable option that retains a nnechanistic 
grounding and relaxes identifiability issues. Recent theoreti- 
cal approaches to guaranteeing observability of large-scale 
nonlinear systenns^° nnay be useful in such efforts. Neverthe- 
less, based on the argunnents presented above, we conclude 
that in the long ternn, MMs are better suited for the ultinnate 
purposes of MBDD and tailored chennotherapy. 
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